Haynie Presentation

Ernesto Carrella

March 29, 2016

Objectives

  • Policy Simulator
    • Agents Flexibility
    • Model Flexibility
  • Policy Optimization

The One Agent Problem

  • Find the most profitable spot to fish
  • Constraints:
    • No biomass information
    • Environment changes over time
  • Subproblems:
    • How to explore
    • Explore-Exploit Tradeoff

Multiple Agents

  • Other boats consume biomass
  • You can use other boats information
  • How to imitate?
  • With probability \(p\) explore, with probability \(i\) ask a friend otherwise exploit

Many Agents

Oil Prices

What information they have and they act on

  • Associate a choice with profits (per trip or per month)
  • Compare and imitate profits
  • Proceed by feedback and trial and error

Fish the Line (part 1)

Fish the Line (part 2)

Seventy-Thirty World

ITQ Prices

  • Quotas are distributed 90% reds, 10% blue

Blues are choke species

ITQ drives Gear (start)

ITQ drives Gear (end)

Gear fixes wastes

Optimization

The Future